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(54) Method and device for detecting motion vectors 


(57) A method of detecting motion vectors within a 
predetermined search range for motion-compensation 
predictive coding is disclosed. The method includes the 
steps of searching for first motion vectors between two 
frames which are separated from each other in a time 
dimension by a first frame distance, selecting a second 
frame distance of two frames between which picture 
motion is represented by second motion vectors, mak- 
ing a check whether the predetermined search range 


covers a predetermined percentage of the second 
motion vectors, the check using the first motion vectors 
as estimates of the second motion vectors after com- 
pensation for a difference between the first frame dis- 
tance and the second frame distance, and deciding, 
based on results of the check, whether to increase a 
frame distance for prediction. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention generally relates to motion- 
vector search methods, and particularly relates to a 
motion-vector search method used for inter-frame pre- 
dictive coding of image information. 

Image-information-compression coding schemes 
include internationally-standardized H.261 and H.262, 
MPEG1 (moving picture experts group 1), and MPEG2 
(moving picture experts group 2) among others. These 
compression coding schemes employ various compres- 
sion processes such as DCT (discrete cosine trans- 
form), motion-compensation inter-frame prediction, etc. 
Effective enhancement of these compression proc- 
esses is expected to bring about an improvement in 
overall compression rates of these schemes. 

2. Description of the Related Art 

Image-information-compression coding schemes 
include inter-frame predictive coding which draws on 
redundancy in a time dimension to achieve compres- 
sion. In using this inter-frame predictive coding, MPEG1 
and MPEG2 can handle both a forward prediction and a 
backward prediction. The forward prediction detects 
changes between a previous frame and a current frame, 
and generates the current frame based on the previous 
frame. 

Rg.1A is an illustrative drawing for explaining the 
forward prediction. 

As shown in Fig.lA, picture movement between a 
current frame, which is to be forwardly predicted, and a 
reference frame (previous frame) is detected within a 
predetermined range defined for motion-vector search. 
Then, parts of the picture showing no movement are 
provided with zero motion vectors, and parts of the pic- 
ture showing some movement are provided with corre- 
sponding motion vectors. These motion vectors are 
used for coding. 

Fig.lB is an illustrative drawing for explaining the 
motion-vector search. As shown in Fig.lB, a given 
frame is divided into a plurality of blocks B<\, fy, 
Each of these blocks is separately subjected to subse- 
quent DCT and quantization processes. In a motion- 
vector-search process, a given block B N of a forwardly- 
predicted frame is searched for in the reference frame 
within the motion-vector-search range. Namely, a block 
B' N having the highest correlation with the block B N is 
detected within the motion-vector-search range of the 
reference frame. As shown in Fig.1 B, movement of the 
block B N is then represented by a motion vector M N . At 
subsequent stages, a differential between the block B N 
and the block B' N is obtained by aligning these two 
blocks, and is subjected to the DCT and quantization 
processes. Results thus obtained and the motion vector 


M N are transmitted, stored, etc., as a part of coded pic- 
tures. The same processes are applied to all the blocks 
shown in Rg.1B 

In the forward prediction of Fig.lA, the larger the 

5 motion-vector-search range, the longer the detectable 
motion displacement, thereby providing higher com- 
pression rates. However, a larger motion-vector-search 
range requires a longer processing time. 

A bidirectional prediction generates the current 

w frame based on a previous frame (past frame) and a 
subsequent frame (future frame). Fig. 2 is an illustrative 
drawing for explaining the bidirectional prediction. As 
shown in Fig.2, the current frame is coded by using a 
backward motion vector and a forward motion vector 

75 which are obtained based on a backward reference 
frame and a forward reference frame. Assuming the 
same motion-vector-search-range size, the directional 
prediction has a higher prediction efficiency than does 
the forward prediction. Since the directional prediction 

20 suffers from twice the processing load, however, it is a 
general practice to reduce the size of the motion-vector- 
search range by half for the directional prediction. 

Pictures coded based on the forward prediction are 
called P-pictures (predictive pictures), and pictures 

25 coded based on the directional prediction are called B- 
pictures (bidirectionally predictive pictures). Also, pic- 
tures coded by intra-frame coding are called l-pictures 
(intra pictures). MPEG1 and MPEG2 employ a coding 
scheme which combines the intra-frame coding, the for- 

30 wardly-predictive coding, and the directional ly-predic- 
tive coding together, so that a picture sequence can be 
represented as IBBPBBPBB • • • IBBPBBPBBP 
for example. 

In the inter-frame predictive coding of the related 
35 art, a fixed inter-frame distance is used for motion-vec- 
tor search. (The inter-frame distance refers to a time 
distance between frames.) When an inter-frame dis- 
tance is short for the forward prediction and the motion- 
vector-search range is relatively large, for example, 
40 some motion-vector-search process is likely to be 
wasted by searching in excess of a maximum range of 
actually existing picture motions. Also, the inter-frame 
predictive coding of the related art uses a fixed number 
of bidirectionally-predictive-coded frames. An increase 
45 in the number of these frames may result in a situation 
where the motion-vector-search range for the forward 
prediction is not sufficiently large. In this case, the pre- 
diction efficiency is decreased. 

Accordingly, there is a need for a motion-vector- 
so search method which enhances prediction efficiency by 
optimizing an inter-frame distance for the motion-vector 
search in accordance with picture characteristics. 

SUMMARY OF THE INVENTION 

55 

Accordingly, it is a general object of the present 
invention to provide a motion-vector-search method 
which can satisfy the need described above. 

It is another and more specific object of the present 
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invention to provide a motion -vector-search method 
which enhances prediction efficiency by optimizing an 
inter-frame distance for the motion-vector search in 
accordance with picture characteristics. 

In order to achieve the above objects according to 5 
the present invention, a method of detecting motion vec- 
tors within a predetermined search range for motion- 
compensation predictive coding is disclosed. The 
method includes the steps of searching for first motion 
vectors between two frames which are separated from w 
each other in a time dimension by a first frame distance, 
selecting a second frame distance of two frames 
between which picture motion is represented by second 
motion vectors, making a check whether the predeter- 
mined search range covers a predetermined percent- 75 
age of the second motion vectors, the check using the 
first motion vectors as estimates of the second motion 
vectors after compensation for a difference between the 
first frame distance and the second frame distance, and 
deciding, based on results of the check, whether to 20 
increase a frame distance for prediction. 

In the method described above, whether a sufficient 
motion-vector-search range can be maintained under 
an increased frame distance (second frame distance) is 
decided based on the motion vectors obtained under a 25 
current frame distance (first frame distance). Based on 
this decision, the frame distance is subjected to an 
increase to have a larger number of bidirectionally pre- 
dictive pictures, thereby enhancing the prediction effi- 
ciency. Therefore, this method achieves an inter-frame 30 
predictive coding which optimizes an inter-frame dis- 
tance for the motion-vector search in accordance with 
picture characteristics. 

Other objects and further features of the present 
invention will be apparent from the following detailed 35 
description when read in conjunction with the accompa- 
nying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 

Fig.1 A is an illustrative drawing for explaining a for- 
ward prediction; 

Fig.lB is an illustrative drawing for explaining a 
motion-vector search; 

Fig.2 is an illustrative drawing for explaining a bidi- 45 
rectional prediction; 

Fig. 3 is an illustrative drawing for explaining a prin- 
ciple of the present invention; 
Fig.4 is an illustrative drawing showing a forward 
prediction according to the present invention; 50 
Fig. 5 is a flowchart of a process of changing an 
inter-frame distance according to an embodiment of 
the present invention; 

Fig.6 is an illustrative drawing for explaining a check 
on a motion-vector-search range of a bidirectional 55 
prediction according to the present invention; 
Fig.7 is an illustrative drawing for explaining another 
check on a motion-vector-search range of the bidi- 
rectional prediction according to the present inven- 


tion; 

Fig.8 is a block diagram of an embodiment of an 
image processing device according to the present 
invention; and 

Figs.9A through 9F are table charts for explaining 
the reason why the inter-frame distance should 
start from a possible maximum distance. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

In the following, a principle and embodiments of the 
present invention will be described with reference to the 
accompanying drawings. 

Fig.3 is an illustrative drawing for explaining the 
principle of the present invention. In Fig.3, frames O and 
F r F 6 are temporary successive frames. When the 
frame F 2 is to be forwardly predicted based on the cur- 
rent reference frame O, the frame F A is a frame to be 
bidirectionally predicted based on the frames O and F 2 . 
When time comes for a motion-vector search of the 
frame F 2 to be started, the frame F 4 is then the frame to 
be forwardly predicted using the frame F 2 as a refer- 
ence frame. At this time, the frame F 3 is bidirectionally 
predicted using the frames F 2 and F 4 as reference 
frames. Likewise, the frame F 6 will be a frame to be for- 
wardly predicted using the frame F 4 as a reference 
frame, and the frame F 5 will be bidirectionally predicted 
based on the frames F 4 and F 6 . 

Assume that a change in a coding scheme is made 
such that the frame F 5 currently scheduled for the bidi- 
rectional prediction will be forwardly predicted based on 
the frame F 2 after this change. Also, assume that this 
change must be made without a decline in the predic- 
tion efficiency. When such a change is possible, the 
frame F 4 becomes a frame to be bidirectionally pre- 
dicted based on the frames F 2 and F 5 . Moving pictures 
tend to have little change in motion characteristics 
between frames within a short time range. This ten- 
dency provides a reasonable assumption that motion- 
vector characteristics detected between the frames F 5 
and F 2 are similar to those detected between the frames 
F 3 and O. Thus, an evaluation as to whether a sufficient 
range is provided for motion-vector search between the 
frames F 5 and F 2 can be made by looking into the 
frames F 3 and O. 

In Fig. 3, x^ and x B are boundaries to define a 
motion-vector-search range used when the frame F 3 is 
forwardly predicted based on the frame O. Although a 
motion-vector-search range is actually a two-dimen- 
sional range spreading in horizontal and vertical direc- 
tions, only one dimension, either horizontal or vertical, is 
used in explanation for the sake of simplicity. That is, x^ 
and x 13 denote either horizontal boundaries or vertical 
boundaries. Then, a horizontal or vertical component x 
of a motion vector, detected between the frame F 3 and 
the frame O, should satisfy x^ < x < x t3 in order to make 
an appropriate forward prediction for the frame F 3 
based on the frame O. 
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In Fig. 3, x u2 and x ^ define a range within which 
motion vectors detected between the frame F 2 and the 
frame O are contained. This range is used for checking 
whether the boundaries x u3 and x l3 are appropriate for 
forward prediction of the frame F 3 . 5 

Based on an assumption that motions in pictures do 
not have abrupt speed changes in a short time period, 
the boundaries x^ and x , 3 should be equivalent to the 
boundaries x u2 and x )2 after compensation for a frame- 
distance difference. Taking into consideration the inter- 10 
frame distances, the boundaries x u3 and x !3 and the 
boundaries x u2 and x [2 should be related as: 

x u2 =(2/3)(x u3 ) (1) 

x l2 =(2/3)(x l3 ) (2) 

Strictly speaking, all the motion vectors do not possibly 
fall into the above range. Namely, the boundaries x u2 
and x , 2 shown as a hatched region in Fig.3 include most 
of the motion vectors but not all of them. 

When a ratio of the number of the motion vectors 
satisfying x u2 < x' < x j 2 to the total number of motion 
vectors exceeds a predetermined threshold, the bound- 
aries x u2 and x G are regarded as an appropriate range. 
Enlarged in proportion to the inter-frame distance, the 
boundaries x u3 and x , 3 shown by dashed lines in Fig.3 
include the motion vectors by approximately the same 
ratio. Since the motion-vector-search range defined by 
the boundaries x^ and x , 3 can be regarded as appro- 
priate, it is fair to assume that the same motion-vector- 
search range is sufficient for motion-vector search 
between the frames F 5 and F 2 . 

In this manner, when the above-mentioned ratio 
exceeds a certain threshold, the frame F 5 can be for- 
wardly predicted by using the frame F 2 as a reference 
frame. 

There are cases in which the above ratio does not 
exceed the predetermined threshold. It is possible that, 
even under this condition, the motion-vector-search 
range is still appropriate to maintain the current coding 
scheme. On the other hand, when the current motion- 
vector-search range is insufficient even for the current 
coding scheme, a larger motion-vector-search range 
would have to be arranged in order to avoid a decline in 
prediction efficiency. Distinction between these two 
cases can be made by pixel-to-pixel differentials 
between original pictures and predicted pictures cre- 
ated based on motion vectors. 

When the motion-vector-search range is ascer- 
tained to be insufficient, an inter-frame distance for the 
forward prediction is shortened to have a forward pre- 
diction between the frames F 3 and F 2 , thereby regaining 
a sufficient motion-vector-search range. When the 
motion-vector-search range is ascertained to be suffi- 
cient but not enough to satisfy the required condition 
between the above ratio and the predetermined thresh- 
old, a forward prediction is made between the frames F 4 
and F 2 as originally scheduled. 


In this manner, at the time when a motion-vector 
search for the frame O is finished, a decision can be 
made whether to have a next forward prediction 
between the frames F 5 and F 2 . between the frames F 4 
and F 2 , or between the frames F 3 and F 2 . When a 
scene change occurs in pictures, however, this deci- 
sion, which is made as described above, becomes 
invalid. To cope with this situation, a reliability measure 
of the evaluation made on the motion : vector-search 
range between the frames F 2 and O is obtained. 
Namely, pixel-to-pixel differentials between the frames 
F 2 and O are obtained, and are added for all pixels to 
provide an accumulated differential. When this accumu- 
lated differential exceeds a predetermined amount, no 
change is made to the inter-frame distance. 

Fig.4 is an illustrative drawing showing a forward 
prediction according to the present invention. In Fig.4, 
the forward prediction is generalized by using integers N 
and M. A frame F N is a N-th frame when frames are suc- 
cessively counted from the frame O, and, likewise, a 
frame F M is a M-th frame. Currently, a forward prediction 
is made for the frame F N by using the frame O as a ref- 
erence frame. Then, a check is made whether the 
motion-vector-search range is sufficient for the frame 
F M to use the frame O as a reference frame. This check 
is made based on results which are obtained from the 
motion-vector search at the frame F N . 

Under an assumption that no abrupt change is 
present in picture motion, a forward prediction for the 
frame F M requires a motion-vector component x 
detected between the frame F N and the frame O to sat- 
isfy: 

[(N • x IM )/M] < x < [(N • x uM )/M] (3) 

where xj M and x um are boundaries to define the motion- 
vector-search range used between the frame F M and 
the frame O. 

Namely, assuming no abrupt change in picture 
40 motion, a forward prediction of the frame F M based on 
the reference frame O can be made, if motion vectors 
detected between the frame F N and the frame O satis- 
fies the inequality (3) in a sufficient number so that a 
ratio of such motion vectors to all the motion vectors 
45 exceeds a predetermined threshold. In this manner, an 
enhancement of the prediction efficiency can be 
achieved. 

Rg.5 is a flowchart of a process of changing the 
inter-frame distance according to an embodiment of the 
so present invention. 

At a step S1 , an inter-frame distance N for the for- 
ward prediction between the reference frame O and a 
predicted frame is set to 2. and an inter-frame-distance 
increment a is set to 1 . 
55 At a step S2, motion vectors are searched for 
between the frame O and the frame F 2 . 

At a step S3, a check is made whether an accumu- 
lated differential E exceeds a predetermined amount. 
Here, the accumulated differential E is a sum of abso- 
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lute values ol pixel-to-pixel differentials between the 
frame O and the frame F 2 . If the accumulated differen- 
tial E exceeds the predetermined amount, the proce- 
dure goes to a step S7. Otherwise, the procedure goes 
to a step S4. 

At the step S7, the inter-frame distance N is main- 
tained at 2. This is the case where a scene change is 
present. 

At the step S4 when the accumulated differential E 
is below the predetermined range, a ratio of the motion 
vectors having a component x satisfying: 

[(N • x B )/(N+a)] < x < [(N • x u3 )/(N+a)] (4) 

to all the motion vectors detected between the frame F 2 
and the frame O is obtained. 

At a step S5, a check is made whether the ratio 
exceeds a predetermined threshold. If it does, the pro- 
cedure goes to a step S6. Otherwise, the procedure 
goes to a step S8. 

At the step S6, the inter-frame distance is increased 
to N+a for subsequent forward predictions. (The inter- 
frame distance is increased to 3 according to the condi- 
tions set at the step S1 .) 

At the step S8 when the ratio is below the predeter- 
mined threshold, a check is made whether an accumu- 
lated pixel-to-pixel differential between a forwardly- 
predicted-frame-F 2 result and the frame O exceeds a 
predetermined amount. If it does not, the procedure 
goes to the step S7 to maintain the inter-frame distance 
N at 2. If the accumulated differential exceeds a prede- 
termined amount, the procedure goes to a step S9. 

At the step S9, the inter-frame distance is 
decreased to N-1 for subsequent forward precfictions. 
(The inter-frame distance is decreased to 1 according to 
the conditions set at the step S1 .) 

In this manner, whether a sufficient motion-vector- 
search range can be maintained under an increased 
inter-frame distance is decided based on the motion 
vectors obtained from the forward prediction. Based on 
this decision, the inter-frame distance is subjected to an 
increase or a decrease to achieve a inter-frame predic- 
tive coding responsive to picture-information character- 
istics. 

Fig. 6 is an illustrative drawing for explaining a check 
on a motion-vector-search range of a bidirectional pre- 
diction according to the present invention. The same as 
in Fig.4, a forward prediction is currently made* for the 
frame F N by using the reference frame O, which is pro- 
vided N-frames before in a time dimension. Also, a 
backward prediction of the frame B n for the bidirectional 
prediction is made based on the frame F N . Based on 
motion-vector-search results for the frame F N , a check 
is made whether a sufficient backward motion-vector- 
search range is maintained for the bidirectional predic- 
tion of the frame B n even when the forward-prediction is 
made for the frame F M . 

Under an assumption that no abrupt change is 
present in picture motion, a backward prediction of the 


frame B n based on the frame F M requires a motion-vec- 
tor component x detected between the frame F N and the 
frame O to satisfy: 

5 [(N • x nIb )/(M-n)] < x < [(N • x nub )/(M-n)] (5) 

where x n j b and x nub are boundaries to define the back- 
ward motion-vector-search range used between the 
frame B n and the frame F M . Here, N in the inequality (5) 

10 is the inter-frame distance between the frame F N and 
the frame O, and (M-n) is the inter-frame distance 
between the frame F M and the frame B n . That is, the 
range defined by the inequality (5) is equivalent to the 
backward motion-vector-search range defined by the 

15 boundaries x n)b and x nub after compensation for a differ- 
ence of these inter-frame distances. 

Under an assumption of no abrupt motion change, 
a sufficient backward motion-vector-search range can 
be maintained even when the backward reference 

20 frame is changed from the frame F N to the frame F M , 
i.e., even when a frame forwardly predicted based on 
the reference frame O is changed from the frame F N to 
the frame F M . This sufficient backward motion-vector- 
search range can be maintained for any frames appear- 

25 ing immediately after the reference frame O which satis- 
fies the inequality (5) together with the frame F N . In 
actuality, a requirement is that a ratio of motion vectors 
satisfying the inequality (5) to all the motion vectors 
detected between the frame F N and the reference frame 

30 O exceed a predetermined threshold. As long as this 
requirement is met. the frame B n can be backwardly 
predicted based on the frame F M . 

Accordingly, a check as to whether the inter-frame 
distance can be increased may involve two decision 

35 making processes. First, a check may be made whether 
the vector-search range is sufficient for a forward pre- 
diction under an increased inter-frame distance. Then, 
another check may be made whether the vector-search 
range is sufficient for a backward prediction under the 

40 increased inter-frame distance. In the flowchart of Fig.5, 
for example, both of these two checks may be made at 
the step S4. 

In this manner, whether a sufficient motion-vector- 
search range for bidirectional prediction can be main- 

45 tained under an increased inter-frame distance is 
decided based on the motion vectors obtained from the 
forward prediction. Based on this decision, the inter- 
frame distance for the forward prediction is subjected to 
an increase or a decrease, and, in response, the 

so number of bidirectionally predicted frames is increased 
or decreased. 

Fig. 7 is an illustrative drawing for explaining another 
check on a motion-vector-search range of the bidirec- 
tional prediction according to the present invention. A 

55 check shown in Fig. 7 is used in the same manner as the 
check of Fig.6, and provides another method of decid- 
ing whether the motion-vector-search range is sufficient 
for a bidirectional prediction under an increased inter- 
frame distance. 
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The same as in Fig.4 and Fig.6, a forward predic- 
tion is currently made for the frame F N by using the ref- 
erence frame 0, which is provided N-frames before in a 
time dimension. Also, a backward prediction of the 
frame B n for the bidirectional prediction is made based 
on the frame F N . Based on backward-motion-vector- 
search results obtained between the frame F N and the 
frame B n , a check is made whether a sufficient back- 
ward motion-vector-search range is maintained for the 
bidirectional prediction of the frame B n even when the 
forward-prediction is made for the frame F M . 

Under an assumption that no abrupt change is 
present in picture motion, a backward prediction of the 
frame B n based on the frame F M requires a motion-vec- 
tor component x detected between the frame B n and the 
frame F N to satisfy: 

[(N-n) • x njb /(M-n)] < x < [(N-n) • x mb /(M-n)] (6) 

where x nib and x nub are boundaries to define the back- 
ward motion-vector-search range used between the 
frame B n and the frame F M . Here, (N-n) in the inequality 
(6) is the inter-frame distance between the frame F N 
and the frame B n , and (M-n) is the inter-frame distance 
between the frame F M and the frame B n . That is, the 
range defined by the inequality (6) on the frame F N is 
equivalent to the backward motion-vector-search range 
defined by the boundaries x n!b and x nub on the frame F M 
after compensation for a difference of the inter-frame 
distances. 

Under an assumption of no abrupt motion change, 
a sufficient backward motion-vector-search range can 
be maintained even when the backward reference 
frame is changed from the frame F N to the frame F M , 
i.e., even when a frame forwardly predicted based on 
the reference frame O is changed from the frame F N to 
the frame F M . This sufficient backward motion-vector- 
search range can be maintained for any frames appear- 
ing immediately after motion-vector-search results sat- 
isfying the inequality (6) are obtained. In actuality, a 
requirement is that a ratio of motion vectors satisfying 
the inequality (6) to all the motion vectors detected 
between the frame F N and the frame B n exceed a pre- 
determined threshold. As long as this requirement is 
met, the frame B n can be backwardly predicted based 
on the frame F M . 

In this manner, whether a sufficient motion-vector- 
search range for bidirectional prediction can be main- 
tained under an increased inter-frame distance is 
decided based on the motion vectors obtained from the 
bidirectional prediction. Based on this decision, the 
inter-frame distance for the forward prediction is sub- 
jected to an increase or a decrease, and, in response, 
the number of bidirectionally predicted frames is 
increased or decreased. 

Fig.8 is a block diagram of an embodiment of an 
image processing device according to the present 
invention. The image processing device of Fig.8 
includes a motion-detection unit 1, a frame memory 2, a 


10 

first operation unit 3, a DCT unit 4, a quantization unit 5, 
a variable-length coding unit 6, an inverse-quantization 
unit 7, an inverse-DCT unit 8, a second operation unit 9, 
a frame memory 10, a local-decoder unit 11, a statist! - 

5 cal-analysis unit 1 2, a coding-pattern-determination unit 
13, a coding-pattern-based control unit 14, and an anal- 
ysis/determination unit 15. 

The frame memory 2 has a multi-bank structure to 
cope with different inter-frame distances which are used 

w for detection of motion vectors. The frame memory 1 0 of 
the local-decoder unit 1 1 has two banks for storing pic- 
tures of the forward reference and the backward refer- 
ence. The first operation unit 3 and the second 
operation unit 9 are in a through operation mode to pass 

75 data through when the intra-frame coding is applied. 
When the inter-frame coding is used, the first operation 
unit 3 operates as a subtracter, and the second opera- 
tion unit 9 operates as an adder. 

Motion vectors detected by the motion-detection 

20 unit 1 are supplied to the statistical-analysis unit 12 of 
the coding-pattern-analysis/determination unit 15. The 
statistical-analysis unit 12 obtains statistics of the mag- 
nitude of the motion vectors. Based on the obtained sta- 
tistics, the coding-pattern-determination unit 13 

25 determines a coding pattern of pictures by deciding the 
inter-frame distances for predictions, and notifies the 
coding-pattern-based control unit 14 of the determined 
coding pattern. The coding-pattern-based control unit 
14 takes care of bank management of the frame mem- 

30 ory 2 according to the inter-frarne distances of the cod- 
ing pattern. Also, the coding-pattern-based control unit 
1 4 is responsible for control of the first operation unit 3, 
the DCT unit 4, the quantization unit 5, the variable- 
length coding unit 6, the inverse-quantization unit 7, the 

35 inverse-DCT unit 8, the second operation unit 9, and the 
frame memory 10, according to the coding pattern. 

In the case of the I picture, the first operation unit 3 
and the second operation unit 9 are in a through opera- 
tion mode to pass the data through. Picture information 

40 is DCT-transformed by the DCT unit 4, is quantized by 
the quantization unit 5, and is coded by the variable- 
length coding unit 6 before being output from the image 
processing device. Also, the transformed and quantized 
picture information is inverse-quantized by the inverse- 

45 quantization unit 7, and is inverse-DCT-transformed by 
the inverse-DCT unit 8 before being stored in the frame 
memory 10. 

In the case of the P picture, the motion-detection 
unit 1 reads from the frame memory 2 a previous frame 

so in accordance with the inter-frame distance of the for- 
ward prediction, and compares this previous frame with 
the current frame to obtain motion vectors within a 
motion-vector-search range. The first operation unit 3 is 
controlled to work as a subtracter, and the second oper- 

55 ation unit 9 is controlled to serve as an adder. The first 
operation unit 3 receives each block of the current frame 
from the motion-detection unit 1 , and receives each cor- 
responding block of the previous frame from the frame 
memory 10 in accordance with the detected motion vec- 
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tors. Then, the first operation unit 3 takes block-to-block 
differentials between the current frame and the previous 
frame. The block-to-block differentials are coded by the 
DCT unit 4, the quantization unit 5, and the variable- 
length coding unit 6 to achieve inter-frame coding of the 5 
current frame. The second operation unit 9 obtains a 
sum between these differentials and the previous frame 
to obtain a predicted current frame, which is stored in 
the frame memory 10. 

In the case of the B picture, the coding-pattern- 10 
based control unit 14 determines the number of B pic- 
tures inserted between a P picture and one of an I pic- 
ture and a P picture. As previously described, the B 
picture is predicted by using the forwardly-predicted P 
picture and the reference picture, which is one of an I 15 
picture and a previous P picture. In order to achieve this, 
pictures are generally provided in a partially reversed 
order at the time of coding. When a picture sequence is 
I1B2P3 (i.e., a sequence of an intra picture, a bidirec- 
tionally predictive picture, and a forwardly predictive pic- 20 
ture), for example, an actual picture sequence for 
coding is 11 P3B2. Namely, a first frame is coded as an I 
picture based on intra-frame coding, and, then, a third 
frame is coded as a P picture based on forward predic- 
tion. Finally, a second frame is coded based on bidirec- 25 
tional prediction by using the I picture and the P picture. 

In MPEG, three different modes are prepared for 
the bidirectional prediction. A first mode is use of only 
the forward prediction. A second mode is use of only the 
backward prediction, and a third mode is use of both the 30 
backward prediction and the forward prediction. The 
best mode among these three mode is determined for 
each block, and is used for coding the respective block. 
In the following description, the third mode using both 
the backward prediction and the forward prediction will 35 
be taken as an example for the sake of simplicity of 
explanation. 

The frame memory 2 is controlled by the coding- 
pattern -based control unit 14 based on the determined 
coding pattern, and the motion-detection unit 1 40 
searches for motion vectors for the forward prediction 
and the backward prediction of the bidirectional predic- 
tion. The first operation unit 3 and the second operation 
unit 9 are controlled in the same manner as in the case 
of coding the P picture. Both banks for the forward pre- 45 
diction and the backward prediction are used in the 
frame memory 10. 

The motion-detection unit 1 reads from the! frame 
memory 2 two reference frames for the forward predic- 
tion and the backward prediction, and compares the so 
current frame with both the forward reference frame and 
the backward reference frame to obtain motion vectors 
within a motion-vector-search range. The first operation 
unit 3 receives each block of the current frame from the 
motion-detection unit 1 , and receives each correspond- 55 
ing block of these two reference frames from the frame 
memory 10 in accordance with the detected motion vec- 
tors. Then, the first operation unit 3 takes block-to-block 
differentials between the current frame and an average 


of the two reference frames. The block-to-block differen- 
tials are coded by the DCT unit 4, the quantization unit 
5, and the variable-length coding unit 6 to achieve bidi- 
rectionally predictive coding of the current frame. 

The present invention is not limited to the above 
described embodiment, but other variations and modifi- 
cations can be made. For example, inter-frame differ- 
ences between the reference frame and a frame to be 
predicted (forward prediction or bidirectional prediction) 
may be obtained to check the existence of a scene 
change. Namely, an absolute-value sum of the inter- 
frame differences between the reference frame and the 
frame to be predicted is obtained and compared with a 
predetermined value. This may be done by the motion- 
detection unit 1 and the statistical -analysis unit 12, for 
example. When this sum exceeds the predetermined 
value, the coding-pattern-based control unit 14 controls 
the other elements so as not to change the inter-frame 
distances. 

Further, an absolute- value sum of differences 
between an original frame and a prediction- resulted 
frame (forward prediction or bidirectional prediction) 
may be obtained and compared with a predetermined 
value. This may be done by the coding-pattern-based 
control unit 14. When this sum exceeds the predeter- 
mined value, the coding-pattern-based control unit 14 
controls the other elements to shorten the inter-frame 
distance between a reference frame and a frame to be 
predicted. In this manner, the inter-frame distance is 
reduced to regain an appropriate motion-vector-search 
range. 

Preferably, the inter-frame distance is set at the 
possible maximum distance of the device at the start of 
the moving-picture coding of the present invention. For 
example, when a forward-prediction inter-frame dis- 
tance M is 3 at a maximum according to the capacity of 
the device, the forward-prediction inter-frame distance 
M should start from 3 in the moving-picture coding. 

Rgs.9A through 9F are table charts for explaining 
the reason why the inter-frame distance should start 
from the possible maximum distance. In Figs.9A 
through 9F, the forward -prediction inter-frame distance 
M is changed once in every 6 frames. In each table 
chart of Figs.9A through 9F, the top row shows the for- 
ward-prediction inter-frame distance M, the middle row 
shows a sequence of I, P, and B pictures of the input pic- 
ture information, and the bottom row shows a coded- 
picture sequence of I, P, and B pictures. A numeral after 
the symbol I, P, or B denote the frame number. For 
example, 10, P1, P2, P3 t P4, P5, and B6 represent an I 
picture of frame number 1, P pictures of frame numbers 
2-5, and a B picture of frame number 6, respectively. 

Fig.9A shows a case in which an initial inter-frame 
distance for the forward prediction is 1. In Fig.9A, the 
forward-prediction inter-frame distance M (hereinafter, 
merely referred to as an inter-frame distance unless 
there is possibility of creating confusion) is changed 
from 1 , 2, to 1 , successively. When a picture sequence 
of 10, P1 , P2, P3, • • • is provided as the picture infor- 
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mation at the start of the picture coding, a coded-picture 
sequence 10, P1, P2, P3, * • • is obtained with a delay 
of one frame period because of processing time for cod- 
ing. 

When the initial value of the inter-frame distance M 
is started from 1 as shown in Fig.9A, a coded frame is 
not present for a certain frame period, as shown by the 
symbol x. Namely, in the frame period indicated by the 
symbol x, P7 should be output as a coded frame ahead 
of B6, but is still in the process of coding. This lack of the 
frame occurs after the inter-frame distance M is 
changed from 1 to 2. 

Fig.9B shows a case in which an initial inter-frame 
distance for the forward prediction is 1. In Fig.9B, the 
forward-prediction inter-frame distance M is changed 
from 1 , 2 to 3, successively. 

When the initial value of the inter-frame distance M 
is 1 as shown in Fig.9B, a coded frame is not present for 
a certain frame period, as shown by the symbol x. This 
lack of the frame occurs after the inter-frame distance M 
is changed from 1 to 2 and after it is changed from 2 to 
3. 

Fig.9C shows a case in which the inter-frame dis- 
tance M is started at 2 and changed to 3. In this case, a 
coded frame is lacking during a certain frame period 
shown by the symbol x, and this occurs after the inter- 
frame distance M is changed from 2 to 3 

Figs.9D through 9F show cases in which the inter- 
frame distance M is initially at the maximum distance of 
3. Fig.9D shows a case in which the inter-frame dis- 
tance M is changed from 3, 2, 3, 2, to 1 , successively. In 
Fig.9E, the inter-frame distance M is changed from 3, 2, 
1 , 2, 1 , to 2, successively. Fig.9F shows changes of the 
inter-frame distance M from 3, 2, 1 , 2, 3, to 2. In these 
figures, a picture sequence of BO, B1, 12, B3, • • • is 
provided as the picture information at the start of the 
picture coding, and a coded-picture sequence 12, BO. 
B1 , • • • is obtained with a delay of three frame periods 
because 12 should be coded first ahead of BO and B1 . 

In the cases of Figs.9D through 9F, an initial value 
of the inter-frame distance is set to the possible maxi- 
mum value, so that the delay of the coded-picture 
sequence is maximized from the beginning. As a result, 
a change in the inter-frame distance M does not bring 
about a frame period lacking a coded frame. Figs.9D 
through 9F show only the cases in which the inter-frame 
distance M is changed by ±1. However, even when the 
inter-frame distance M is changed by ±2, a maximum 
initial value of the inter-frame distance ensures that any 
frame period has a coded frame. 

Occurrence of such a frame period as having no 
coded frame does not mean that a motion-vector- 
search process is impaired. In the operation of the 
image processing device, however, discontinuity in the 
coded-frame sequence caused by such a frame period 
is undesirable in terms of the stability of the operation. 
As described above, the use of the possible maximum 
value for the initial inter-frame distance ensures continu- 
ity of the coded-frame-output data stream. Also, if image 


characteristics are known or can be estimated in 
advance, the inter-frame distance may be set to a dis- 
tance of the highest occurrence. 

As described above, according to the present 

5 invention used in a coding scheme employing a combi- 
nation of the forward prediction and the bidirectional 
prediction, an inter-frame distance with an appropriate 
motion-vector-search range is determined based on 
detected motion vectors by drawing on an assumed 

10 image characteristic that no abrupt change is present in 
picture motions within a short time period. In the case of 
motion vectors being small, an increase in the inter- 
frame distance is justified since an appropriate motion- 
vector-search range can be maintained after the 

15 increase. In this case, the inter-frame distance is 
stretched to increase the number of bidirectionally-pre- 
dicted frames which have high prediction efficiency 

Further, the present invention is not limited to these 
embodiments, but various variations and modifications 

20 may be made without departing from the scope of the 
present invention. 

Claims 

25 1 . A method of detecting motion vectors within a pre- 
determined search range for motion-compensation 
predictive coding, said method characterized by 
comprising the steps of: 

30 a) searching for first motion vectors between 

two frames which are separated from each 
other in a time dimension by a first frame dis- 
tance; 

b) selecting a second frame distance of two 
35 frames between which picture motion is repre- 
sented by second motion vectors; 

c) making a check whether said predetermined 
search range covers a predetermined percent- 
age of said second motion vectors, said check 

40 using said first motion vectors as estimates of 

said second motion vectors after compensation 
for a difference between said first frame dis- 
tance and said second frame distance; and 

d) deciding, based on results of said check, 
45 whether to increase a frame distance for pre- 
diction. 

2. The method as claimed in claim 1 , 
characterized in that 

50 

said step a) comprises a step of obtaining said 
first motion vectors within said predetermined 
range between a reference frame (O) and a for- 
wardly-predicted frame (F N ) in order to for- 
55 wardly predict said forwardly-predicted frame 

(F N );and 

said step d) comprises a step of deciding, 
based on said results of said check, whether to 
increase said frame distance for forward pre- 
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diction from said first frame distance (N) to said 
second frame distance (M). 

3. The method as claimed in claim 2, 
characterized in that said step c) further comprises 5 
a step of changing a scale of either said predeter- 
mined search range or said first motion vectors in 
order to achieve said compensation. 

4. The method as claimed in claim 3, 10 
characterized in that said step c) further comprises 

a step of changing said scale by a ratio between 
said first frame distance (N) and said second frame 
distance (M). 

75 

5. The method as claimed in claim 3, 
characterized in that said step c) comprises the 
steps of: 

c1) obtaining a percentage of said first vectors 20 
(x, y) satisfying: 

N • x |M /M < x < N • x uM /M 

N *yiM /M <y< N -y U M /M 25 

wherein N is said first frame distance. M is said 
second frame distance. X| M and Xu M are hori- 
zontal boundaries of said predetermined 
search range, and y, M and y uM are vertical 30 
boundaries of said predetermined search 
range; and 

c2) checking whether said percentage exceeds 
said predetermined percentage. 

35 

6. The method as claimed in claim 1 , characterized in 
that 

said step a) comprises a step of obtaining said 
first motion vectors between a reference frame 40 
(O) and a forwardly-predicted frame (F N ) in 
order to forwardly predict said forwardly-pre- 
dicted frame (F N ), 

said step b) comprises a step of selecting said 
second frame distance in order to backwardly 45 
predict a bidirectional ly-predicted frame (Bp) 
based on a backward-reference frame (F M ), 
and * - 

said step d) comprises a step of deciding, 
based on said results of said check, whether to so 
increase said frame distance for forward pre- 
diction from said first frame distance (N) so that 
a frame distance for backward prediction is 
increased to said second frame distance (M). 

55 

7. The method as claimed in claim 6, 
characterized in that said step c) further comprises 
a step of changing a scale of either said predeter- 
mined search range or said first motion vectors in 


order to achieve said compensation. 

8. The method as claimed in claim 7, 
characterized in that said step c) further comprises 
a step of changing said scale by a ratio between 
said first frame distance (N) and said second frame 
distance (M). 

9. The method as claimed in claim 1 , 
characterized in that 

said step a) comprises a step of obtaining said 
first motion vectors between a backward -refer- 
ence frame and a bidirectional ly-predicted 
frame (B n ) in order to backwardly predict said 
bidirectionally-predicted frame (B n ), 
said step b) comprises a step of selecting said 
second frame distance in order to backwardly 
predict a bidirectionally-predicted frame based 
on a backward-reference frame, and 
said step d) comprises a step of deciding, 
based on said results of said check, whether to 
increase said frame distance for forward pre- 
diction so that a frame distance for backward 
prediction is increased from said first frame dis- 
tance to said second frame distance. 

10. The method as claimed in claim 9, 
characterized in that said step c) further comprises 
a step of changing a scale of either said predeter- 
mined search range or said first motion vectors in 
order to achieve said compensation. 

11. The method as claimed in claim 10, 
characterized in that said step c) further comprises 
a step of changing said scale by a ratio between 
said first frame distance and said second frame dis- 
tance. 

12. The method as claimed in claim 2, further charac- 
terized by comprising the steps of: 

e) obtaining a percentage of said first vectors 
(x, y) satisfying: 

N * x nib^M-") < x < N • x mb /(M-n) 
N-y nlb /(M-n)<y < N • y nub /(M-n) 

wherein N is said first frame distance, M is said 
second frame distance, n is a distance 
between a forward-reference frame and a bidi- 
rectionally-predicted frame which is to be back- 
wardly predicted based on a backward- 
reference frame distanced from said forward- 
reference frame by said second frame dis- 
tance, x^ and x nub are horizontal boundaries 
of a search range for backward prediction, and 
y n i b and y nub are vertical boundaries of said 
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search range for said backward prediction; and 

f) checking whether said percentage exceeds a 
predetermined percentage. 

13. The method as claimed in claim 2, further charac- 5 
terized by comprising the steps of: 

e) obtaining third vectors between a backward- 
reference frame and a bidirectionally-predicted 
frame which is backwardly predicted based on io 
said backward-reference frame and is dis- 
tanced from a forward-reference frame by a 
frame distance n; 

0 obtaining a percentage of said third vectors 

(x, y) satisfying: 15 

(N-n) • x nIb /(M-n) < x < (N-n) • x^M-n) 

(N-n) . y nIb /(M-n) < y < (N-n) • y mb /(M-n) 

20 

wherein N is said first frame distance, M is said 
second frame distance, x njb and x nub are hori- 
zontal boundaries of a search range for back- 
ward prediction, and y n t b and y nub are vertical 
boundaries of said search range for said back- 25 
ward prediction: and 

g) checking whether said percentage exceeds 
a predetermined percentage. 

14. The method as claimed in claim 2, further charac- 30 
terized by comprising the steps of: 

h) obtaining a difference between a forwardly- 
predicted frame (F N ) and a corresponding 
frame which is obtained based on a forward 35 
prediction; 

i) checking whether said difference exceeds a 
predetermined amount; and 

j) shortening said frame distance for said for- 
ward prediction when said difference exceeds 40 
said predetermined amount. 

15. The method as claimed in claim 2, further charac- 
terized by comprising the steps of: 

45 

h) obtaining a difference between a bidirection- 
ally-predicted frame and a corresponding 
frame which is obtained based on a bidirec- 
tional prediction; 

i) checking whether said difference exceeds a so 
predetermined amount; and 

j) shortening said frame distance for said for- 
ward prediction when said difference exceeds 
said predetermined amount. 

55 

16. The method as claimed in claim 2, further charac- 
terized by comprising the steps of: 

k) obtaining a difference between said refer- 


ence frame (O) and said forward ly-predicted 
frame (F N ); 

I) checking whether said difference exceeds a 

predetermined amount; and 

m) skipping said step c) and maintaining said 

frame distance for said forward prediction when 

said difference exceeds said predetermined 

amount. 

17. The method as claimed in claim 2, further charac- 
terized by comprising the steps of: 

n) determining a possible maximum frame dis- 
tance for said forward prediction; and 
o) starting said motion-compensation predic- 
tive coding by using said possible maximum 
frame distance for said forward prediction. 

1 8. A device for detecting motion vectors within a pre- 
determined search range for motion-compensation 
predictive coding, said device 

characterized by comprising: 

motion-detection means (1) for searching for 
first motion vectors between two frames which 
are separated from each other in a time dimen- 
sion by a first frame distance; 
analysis-and-determination means (15) for 
selecting a second frame distance of two 
frames between which picture motion is repre- 
sented by second motion vectors, and for mak- 
ing a check whether said predetermined 
search range covers a predetermined percent- 
age of said second motion vectors, said check 
using said first motion vectors as estimates of 
said second motion vectors after compensation 
for a difference between said first frame dis- 
tance and said second frame distance; 
control means (14) for controlling, based on 
results of said check, a change in a frame dis- 
tance for prediction. 

19. The device as claimed in claim 18, 
characterized in that said motion-detection means 
(1) comprises means for obtaining said first motion 
vectors between a reference frame and a forwardly- 
predicted frame in order to forwardly predict said 
torwardly-predicted frame, and said control means 
(14) comprises means for increasing said frame 
distance for forward prediction from said first frame 
distance to said second frame distance based on 
said results of said check. 

20. The device as claimed in claim 19, 
characterized in that said analysis-and-determina- 
tion means (15) further comprises means for mak- 
ing a check whether a search range for backward 
prediction is sufficient after said frame distance for 
said forward prediction is increased, said check 
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using said first motion vectors as estimates of 
motion vectors used in said backward prediction. 
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